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AMENDMENTS TO THE CLAIMS 

This following is a listing of claims pending in the instant application: 

CLAIMS 

1. (Currently Amended) A method for unifying speech user interface and graphic user 
interface commands, comprising the steps of: 

receiving grammar specifying a syntax of at least one speech command and having 
semantic information; 

processing the grammar to extract the semantic information for use with both a 
graphical user interface and a speech user interface; 

receiving a user input to select at least one component in the graphical user 
Interface during a navigation of tine graplnical user interface; 

audibly receiving the at least one speech command associated with the at least one 
component from the speech user interface; 

generating semantic directives from user supplied input text, the user input, and the 
at least one speech command to update a recognition vocabulary for recoonizina one or 
more non-unified components of the Graphical user interface: 

parsing the grammar between the graphical user interface and the speech user 
interface in accordance with the semantic directives to unify the graphical user interface 
with the grammar from the recognition vocabulary: 

visually presenting the at least one speech command in a visual prompt of the 
graphical user interface responsive to the step of audibly receiving; and 

building a corresponding speech command for a plurality of speech commands 
associated with a plurality of components, 

wherein the corresponding speech command is a single instance of a plurality of 
speech commands associated with a selection of one or more components of the graphical 
user interface during the navigation of the graphical user interface. 

2. (Original) The method of claim 1, wherein the method further comprises the step of 
generating graphical user interface elements corresponding to the semantic information in 
the grammar. 
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3. (Original) The method of claim 1, wherein the method further comprises the step of 
generating speech grammar from the grammar and semantic information. 

4. (Original) The method of claim 1 , wherein the method further uses the grammar and the 
semantic information to generate visual graphical user interface elements required to 
implement a set of commands contained in the grammar. 

5. (Cancelled) The method of claim 1 , wherein the step of processing further comprises 
processing the semantic information to generate semantic directives used for parsing the 
grammar between the graphical user interface and the speech user interface. 

6. (Currently Amended) A method for unifying speech user interface and graphic user 

interface commands, comprising the steps of: 

receiving user entered text via a graphical user interface; 

processing the user entered text for semantic directives via the graphical user 
interface; 

monitoring the user entered text and adding input context associated with a se l ect i on 
of at least one component navigation in the graphical user interface correspondino to the 
user entered text; 

updating a speech recognizer with the user entered text and for recognizing one or 
more non-unified components of the graphical user interface from the semantic i nformat i on 
directives : 

audibly receiving at least one speech command associated with the selection of the 
at least one component from the navigation of the speech user interface; 

visually presenting the at least one speech command in a visual prompt of the 
graphical user interface responsive to the step of audibly receiving; and 

building a corresponding speech command for a plurality of speech commands 
associated with a plurality of components and non-unified components . 

wherein the corresponding speech command is a single instance of a plurality of 
speech commands associated with a selection of one or more components of the graphical 
user interface during the navigation of the graphical user interface. 
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7. (Original) Tlie method of claim 6, wherein the step of updating the speech recognizer 
comprises the step of accepting new text information and input context to augment and 
update a speech grammar and recognition vocabulary of the speech recognizer. 

8. (Original) The method of claim 6, wherein the method further comprises the step of 
updating the graphical user interface. 

9. (Original) The method of claim 8, wherein the step of updating the graphical user 
interface comprises the steps of updating graphical user interface directives and elements 
to maintain the graphical user interface unified with the speech grammar. 

10. (Original) The method of claim 6, wherein the method further comprises forming a 
window for displaying a speech interface command as it is being built using the graphical 

user interface. 
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1 1 . (Currently Amended) A system having a unified speech user interface and graphical 
user interface, comprising: 

a display for providing an output for graphic user interface elements; and 
a processor coupled to the display, the processor programmed to: 

receive grammar from a user input text specifying a syntax of at least one 
speech command and having semantic information; 

process the grammar from the text to extract the semantic information for use 
with both a graphical user interface and a speech user interface; 

receive a user input to select at least one component in the graphical user 
interface during a navigation of the graphical user interface; 

audibly receive the at least one speech command associated with the at least 
one component from the speech user interface; 

visually present the at least one speech command in a visual prompt of the 
graphical user interface responsive to the step of audibly receiving; and 

build a corresponding speech command for a plurality of speech commands 
associated with a plurality of non-unified components in accordance with the semantic 
information . 

updating a recognition vocabulary using the semantic information for 
recognizing the plurality of non-unified components of the graphical user interface; 
wherein the corresponding speech command is a single instance of a plurality of speech 
commands associated with a selection of one or more components of the graphical user 
interface during the navigation of the graphical user interface. 

12. (Currently Amended) The system of claim 11, wherein the processor is further 
programmed to generate graphical user interface elements corresponding to the semantic 
information in the grammar and navigate to the graphical user interface elements in 
response to receiving a speech command . 

13. (Original) The system of claim 11, wherein the processor is further programmed to 
generate speech grammar from the grammar and semantic information. 
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14. (Original) The system of claim 11, wherein the processor is further programmed to use 
the grammar and the semantic information to generate visual graphical user interface 
elements required to implement a set of commands contained in the grammar. 

15. (Original) The system of claim 11, wherein the processor is further programmed to 
process the semantic information to generate semantic directives used for parsing the 
grammar between the graphical user interface and the speech user interface. 

16. (Currently Amended) A system having a unified speech user interface and graphical 
user interface, comprising: 

a display for providing an output for graphic user interface elements; and 
a processor coupled to the display, the processor programmed to: 

receive user entered text via a graphical user interface; 

process the user entered text via the graphical user interface; 

monitor the user entered text and adding input context associated with a 
selection of at least one unified component in the graphical user interface to the user 
entered text during a navigation of the graphical user interface ; and 

generate semantic directives from the user entered text to update a recognition 
vocabulary for recognizing one or more non-unified components of the graphical user 
interface 

update a speech recognizer with the user entered text and semantic information for 
recognizing a plurality of unified and non-unified components of the graphical user interface: 

audibly receive at least one speech command associated with the selection of 
at least one component from the speech user interface; 

visually present the at least one speech command in a visual prompt of the 
graphical user interface responsive to the step of audibly receiving; and 

build a corresponding speech command for a plurality of speech commands 
associated with a plurality of unified components and non-unified components . 

wherein the corresponding speech command is a single instance of a plurality 
of speech commands associated with a selection of one or more components of the 
graphical user interface during the navigation of the graphical user interface. 
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17. (Original) The system of claim 16, wherein the processor is further programmed to 
update the speech recognizer by accepting new text information and input context to 
augment and update a speech grammar and recognition vocabulary of the speech 
recognizer. 



18. (Original) The system of claim 16, wherein the processor is further programmed to 
update the graphical user interface by updating graphical user interface directives and 
graphical user elements to maintain the graphical user interface unified with the speech 
grammar of the speech user interface. 

19. (Original) The system of claim 16, wherein the processor is further programmed to 
form a window in the graphical user interface enabling the display of a speech interface 
command as a user constructs the speech interface command. 
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20. (Currently Amended) A machine readable storage, having stored thereon a computer 
program having a plurality of code sections executable by a machine for causing the 
machine to perform the steps of: 

receiving grammar specifying a syntax of at least one speech command and having 
semantic information; and 

processing the grammar to extract the semantic information for use with both a 
graphical user interface and a speech user interface 

receiving a user input to select at least one component in the graphical user 
interface during a navigation of the graphical user interface; 

audibly receiving the at least one speech command associated with the at least one 
component from the speech user interface; 

visually presenting the at least one speech command in a visual prompt of the 
graphical user interface responsive to the step of audibly receiving; 

updating a speech recognizer with the user entered text and semantic information for 
recognizing a plurality of non-unified components of the graphical user interface; and 

building a corresponding speech command for a plurality of speech commands 
associated with a plurality of components and non-unified components , 

wherein the corresponding speech command is a single instance of a plurality of 
speech commands associated with a selection of one or more components of the graphical 
user interface during the navigation of the graphical user interface. 
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21 . (Currently Amended) A machine readable storage, having stored thereon a computer 
program having a plurality of code sections executable by a machine for causing the 
machine to perform the steps of: 

receiving user entered text via a graphical user interface; 

processing the user entered text via the graphical user interface; 

monitoring the user entered text and adding input context associated with a selection 
of at least one component in the graphical user interface to the user entered text; 

updating a speech recognizer with the user entered text and semantic information for 
recognizing a plurality of unified and non-unified components of the graphical user interface 

[[■]]; 

audibly receiving at least one speech command associated with the selection of the 
at least one component from the speech user interface; 

visually presenting the at least one speech command in a visual prompt of the 
graphical user interface responsive to the step of audibly receiving; and 

building a corresponding speech command for a plurality of speech commands 
associated with a plurality of unified components and non-unified components , 

wherein the corresponding speech command is a single instance of a plurality of 
speech commands associated with a selection of one or more components of the graphical 
user interface during the navigation of the graphical user interface. 
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